Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fixes limits on Arrow for plexus test #14781

Merged

Conversation

potiuk
Copy link
Member

@potiuk potiuk commented Mar 14, 2021

Arrow must be <1.0.0 for plexus to work


^ Add meaningful description above

Read the Pull Request Guidelines for more information.
In case of fundamental code change, Airflow Improvement Proposal (AIP) is needed.
In case of a new dependency, check compliance with the ASF 3rd Party License Policy.
In case of backwards incompatible changes please leave a note in UPDATING.md.

Arrow must be <1.0.0 for plexus to work
@potiuk
Copy link
Member Author

potiuk commented Mar 14, 2021

I pushed new constraints manually and they caused the test in plexus to fail because of this. I am reverting constraints shortly but this is a permanent fix (until at least plexus provider will be upgraded to use the new arrow release.

@potiuk potiuk requested a review from dstandish March 14, 2021 17:39
@github-actions
Copy link

The PR most likely needs to run full matrix of tests because it modifies parts of the core of Airflow. However, committers might decide to merge it quickly and take the risk. If they don't merge it quickly - please rebase it to the latest master at your convenience, or amend the last commit of the PR, and push it with --force-with-lease.

@github-actions github-actions bot added the full tests needed We need to run full set of tests for this PR to merge label Mar 14, 2021
@potiuk potiuk merged commit 7fff3b1 into apache:master Mar 14, 2021
@potiuk potiuk deleted the fix-arrow-limit-for-failing-plexus-test branch March 14, 2021 19:03
potiuk added a commit to potiuk/airflow that referenced this pull request May 24, 2021
Plexus provider needlessly limits arrow to <1.0.0. This was added
in apache#14781 to fix failing tests, but Plexus uses arrow in a very
limited way and it turned out that just checking for None value
before running arrow.get(), fixes the problem (and we can upgrade
to latest version of arrow as well).
potiuk added a commit that referenced this pull request May 24, 2021
Plexus provider needlessly limits arrow to <1.0.0. This was added
in #14781 to fix failing tests, but Plexus uses arrow in a very
limited way and it turned out that just checking for None value
before running arrow.get(), fixes the problem (and we can upgrade
to latest version of arrow as well).
potiuk added a commit to potiuk/airflow that referenced this pull request Jun 22, 2021
Plexus provider needlessly limits arrow to <1.0.0. This was added
in apache#14781 to fix failing tests, but Plexus uses arrow in a very
limited way and it turned out that just checking for None value
before running arrow.get(), fixes the problem (and we can upgrade
to latest version of arrow as well).

(cherry picked from commit 5dd0802)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
full tests needed We need to run full set of tests for this PR to merge
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants